Bayesian and Frequentist Multiple Testing
نویسندگان
چکیده
We introduce a Bayesian approach to multiple testing. The method is an extension of the false discovery rate (FDR) method due to Benjamini and Hochberg (1995). We also examine the empirical Bayes approach to simultaneous inference proposed by Efron, Tibshirani, Storey and Tusher (2001). We show that, in contrast to the single hypothesis case – where Bayes and frequentist tests do not agree even asymptotically – in the multiple testing case we do have asymptotic agreement.
منابع مشابه
Bayesian Frequentist Multiple Testing
We introduce a Bayesian approach to multiple testing. The method is an extension of the false discovery rate (FDR) method due to Benjamini and Hochberg (1995). We also examine the empirical Bayes approach to simultaneous inference proposed by Efron, Tibshirani, Storey and Tusher (2001). We show that, in contrast to the single hypothesis case – where Bayes and frequentist tests do not agree even...
متن کاملA Decision between Bayesian and Frequentist Upper Limit in Analyzing Continuous Gravitational Waves
Given the sensitivity of current ground-based Gravitational Wave (GW) detectors, any continuous-wave signal we can realistically expect will be at a level or below the background noise. Hence, any data analysis of detector data will need to rely on statistical techniques to separate the signal from the noise. While with the current sensitivity of our detectors we do not expect to detect any tru...
متن کاملComparison of Bayesian and Frequentist Methods in Estimating the Net Reclassification and Integrated Discrimination Improvement Indices for Evaluation of Prediction Models: Tehran Lipid and Glucose Study
Introduction: The Frequency-based method is commonly used to estimate the Net Reclassification Improvement (NRI)- and Integrated Discrimination Improvement (IDI) indices. These indices measure the magnitude of the performance of statistical models when a new biomarker is added. This method has poor performance in some cases, especially in small samples. In this study, the performance of two Bay...
متن کاملComparison between Frequentist Test and Bayesian Test to Variance Normal in the Presence of Nuisance Parameter: One-sided and Two-sided Hypothesis
This article is concerned with the comparison P-value and Bayesian measure for the variance of Normal distribution with mean as nuisance paramete. Firstly, the P-value of null hypothesis is compared with the posterior probability when we used a fixed prior distribution and the sample size increases. In second stage the P-value is compared with the lower bound of posterior probability when the ...
متن کاملBlending Bayesian and frequentist methods according to the precision of prior information with applications to hypothesis testing
The following zero-sum game between nature and a statistician blends Bayesian methods with frequentist methods such as p-values and con dence intervals. Nature chooses a posterior distribution consistent with a set of possible priors. At the same time, the statistician selects a parameter distribution for inference with the goal of maximizing the minimum Kullback-Leibler information gained over...
متن کامل